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ABSTRACT 

This policy brief summarizes a longer report about state 
assessment and accountability systems in all 50 states. It examines the 
extent to which state policies meet the intent of federal policy, 
particularly Title I programs. It asks, "How are states measuring student 
performance and reporting it to the general public?" and "How are states 
holding schools, school districts, and students accountable for student 
outcomes?" It reports that 48 states use a state assessment as their 
principal indicator of school performance but that the frequency of testing 
varies considerably. It looks at how students with special needs are 
assessed, how student performance levels are set, and how student performance 
is reported and disaggregated. It explains how schools and districts hold 
students accountable, how schools should set performance targets and goals, 
and how they should define progress and create consequences for performance. 
It states that, overall, state responses to calls for performance-based 
accountability have not been uniform. Although the systems have common 
elements, such as assessments, standards, and performance reporting, the 
states have found different ways to define what it means for schools to 
succeed, and they use varying indicators to define success. Information on 
assisting low-performing schools and aligning accountability systems with 
Title I are also discussed. (RJM) 
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Assessment and Accountability 
Across the 50 States 



by Margaret E. Goertz and Mark C. Duffy 

cross the United States, policymakers and 
educational leaders are implementing 
accountability and assessment measures in 
response to increasing concerns about and 
calls for improving student performance. What is be- 
coming apparent, however, is that states are interpret- 
ing the call in different ways. Although their policies 
vary, states face similar challenges in creating effec- 
tive and equitable accountability systems. 

Overview 

In recent years, all 50 states have embarked on educa- 
tion initiatives related to high standards and challeng- 
ing content. A central focus of these efforts has been 
the establishment of a common set of academic stan- 
dards for all students, the assessments that measure 
student performance, and accountability systems that 



are at least partially focused on student outcomes. This 
CPRE Policy Brief summarizes a longer report about 
state assessment and accountability systems in all 50 
states and examines the extent to which state policies 
meet the intent of federal policy, particularly Title I. 

We focused on the following questions: 

• How are states measuring student performance and 
reporting it to the general public? 

• How are states holding schools, school districts, 
and students accountable for student outcomes? 

• How aligned are accountability policies for Title 
I and non-Title I schools? 

• How are states assisting low-performing schools? 
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• What challenges do the federal government and 
the states face in designing effective and equitable 
accountability and improvement systems? 

The study was based on information drawn from a 
50-state survey of state assessment and accountabil- 
ity systems conducted by CPRE between February and 
June 2000. 

Measuring Student 
Performance 

Forty-eight states use a state assessment as their prin- 
cipal indicator of school performance. The two other 
states, Iowa and Nebraska, require their districts to 
test students in specified grades or grade spans, but 
leave the choice of assessment instrument to the lo- 
cality. 

The Improving America’s Schools Act (IAS A) of 1 994 
requires that states test students at least once during 
each of three grade spans: third-to-fifth, sixth-to-ninth, 
and tenth-to-twelfth. But we found that states assess 
students considerably more often with some states test- 
ing students in almost every grade. The states fell into 
one of three categories in 1999-2000: 

• The majority of states test students in a single 
grade per subject at each of three levels: elemen- 
tary, middle, and high school. 

• Twelve states test consecutive grades between 
grades 2 or 3 and at least grade 8 in the same 
subject areas using the same assessment. 

• Three states test consecutive grades between 
grades 2 or 3 and 8 in different subjects and/or 
using multiple assessments. 

Although most state assessment systems begin in the 
third grade, seven states have developed assessments 
for earlier grades as a way of identifying and diagnos- 



ing problems in student learning early in a child’s ca- 
reer. Other states require districts to test reading in 
early grades. 

Twenty-nine states administer a combination of crite- 
rion-referenced and norm-referenced tests. Seventeen 
states use only criterion-referenced tests and two states 
use only norm-referenced assessments. Only one in 
five states now have their own local testing require- 
ments, a result of the expansion of state testing pro- 
grams. 

Assessing Students with 
Special Needs 

States face both technical and political challenges as 
they bring students with disabilities and students with 
limited-English proficiency into their assessment sys- 
tems. States want to include special student popula- 
tions both to improve the quality of educational op- 
portunities afforded all students, and to provide use- 
ful information about the performance of special needs 
students to parents and the public. 

States report testing more students with disabilities 
and offer a range of test accommodations and modifi- 
cations, but face challenges in developing and imple- 
menting alternative assessments. They have a variety 
of policies regarding whether and when English-lan- 
guage learners are included in state assessments. Some 
exempt English-language learners based on the length 
of their residency, some based on time in an English- 
as-a-Second-Language or bilingual program, and some 
based on their level of English proficiency determined 
by a separate assessment. 

Setting Student Performance Levels 

Title I requires states to establish at least three levels 
of student performance on state assessments — ad- 
vanced, proficient, and partially proficient — in order 
to show how well students are mastering the material 
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in the state content standards. Nearly all of the states 
with statewide assessments had student performance 
levels in place for the 2000-2001 school year. Most 
have created four-to-five levels for student perfor- 
mance, generally adding an additional category of par- 
tial proficiency. States use these performance catego- 
ries for multiple purposes, including student report- 
ing, retention, and awarding high school diplomas. 

A majority of states also collect additional informa- 
tion on student performance including attendance, 
dropout, and graduation rates. 

Reporting and Disaggregating Student 
Performance 



by the design of the accountability system, particu- 
larly who sets what goals for the system, the mea- 
sures of adequate progress, and the consequences of 
meeting or not meeting these goals. State account- 
ability systems fall into three basic categories. 

State-defined accountability systems. Thirty-three 
states set performance goals for schools or districts 
and hold these units directly accountable for meeting 
these outcome goals. These states also establish re- 
wards for meeting or exceeding state goals, sanctions 
for not meeting their targets, or both. The state per- 
formance goals vary along several dimensions, includ- 
ing how performance is measured and whether the 
perfonnance goal is fixed or relative. 



Public reporting of programs and performance is the 
most basic form of school accountability. This gives 
the public information to seek improvements or to 
choose alternative schools for their children. 

Currently, all 50 states produce or require local school 
districts to publish district or school report cards. 
School report cards, prepared in 40 states, include, at 
a minimum, information on student performance on 
state and/or local assessments. Public reports usually 
include information on non-cognitive measures such 
as student attendance, dropout rates, and graduation 
rates as well as indicators of school climate, teacher 
quality, and fiscal resources. Data are commonly re- 
ported on school discipline, safety and climate, teacher 
qualifications and experience, class size or student- 
teacher ratios, and financial information such as per- 
pupil expenditure. 

Thirty-nine states with statewide assessment systems 
report that they disaggregate test data by race/ethnicity 
and gender, a requirement of Title I. Many states also 
disaggregate data in such categories as socio-economic 
status, English proficiency, or free or reduced lunch 
status, but do not always report this information to the 
public. 

Holding Schools, Districts, and 
Students Accountable 

State accountability systems create incentives for stu- 
dents, schools, and school districts to focus on stu- 
dent achievement and continuous progress. The type 
and strength of these incentives are determined largely 







Public reporting. Thirteen states use public reporting 
as their primary accountability mechanism. 

Locally-defined accountability systems. A few states 
have accountability systems that emphasize local stan- 
dards and planning. These states allow districts to es- 
tablish criteria for school performance, but use strate- 
gic plans or district and school improvement plans to 
hold districts accountable for student performance. 

Setting Performance Targets and 
Goals for Schools 

A key component of standards-based reform is estab- 
lishing challenging standards for all students. Account- 
ability systems are largely designed to ensure that 
schools and school districts make continuous and sub- 
stantial progress, within an appropriate timeframe, to- 
ward the goal of all students meeting state levels of 
proficiency and advanced achievement. However, 
there is wide variation in school performance goals 
among the 33 states with state-defined accountability 
systems. 

Most states expect to bring some or all students to 
proficient levels of performance. The measure of pro- 
ficiency, however, is not comparable across states. 
States use different assessments aligned with differ- 
ent standards and set different cut scores for different 
performance levels. States also differ in the percent- 
age of students that are expected to meet basic or pro- 
ficient standards and set different timelines for meet- 
ing their performance goals. 
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Figure 1. Tlie Number of States Using Each of Three Methods to Define School 
Progress in General and Title I Accountability Systems: 1999-2000 




Defining Progress 

Once states have identified performance measures and 
established performance goals, they must determine 
how they will measure annual progress toward these 
goals. Title I requires states to define what they con- 
sider substantial and continuous progress toward per- 
formance goals. Using these definitions of adequate 
yearly progress, states must then identify schools and 
districts in need of improvement. 

States use at least one of three approaches to measure 
school progress: 

• Meet an absolute target: achieve a performance 
threshold that all schools must attain to have 
made satisfactory progress; 

• Make relative growth: meet an annual growth 
target that is based on each school’s past perfor- 
mance and often reflects its distance from state 
goals; and/ or 

• Narrow the achievement gap: reduce the num- 
ber or percentage of students scoring in the low- 
est performance levels. 



As we see in Figure 1, states differ in the type and mix 
of measures they use in defining school progress. In 
addition, states are more likely to incorporate mea- 
sures of continuous progress — relative growth or nar- 
rowing the achievement gap — in their Title I than in 
their general accountability systems. Only a few states 
hold schools accountable for the performance of spe- 
cific groups of students, such as racial/ethnic minori- 
ties or economically-disadvantaged students. 

Creating Consequences for 
Performance: Carrots and Sticks 

Accountability systems create incentives for school 
improvement by defining and measuring performance 
outcomes and progress, and by attaching consequences 
to these outcomes. Consequences for students, schools, 
and school districts vary across states, depending on 
the locus of authority (state versus local) and the state’s 
willingness and capacity to intervene in low-perform- 
ing schools. 

Consequences for schools. Most states direct rewards 
and sanctions to the school level. All 33 states with 
state-defined accountability systems identify low-per- 
forming schools and have some provision for assis- 



tance, from either the state or local school district, as 
well as sanctions to schools that fail to improve after 
a specified period of time. In some states, schools re- 
ceive financial rewards for high levels of performance 
or improvement. A majority of the 33 states require 
low-performing schools to develop improvement or 
action plans that identify strategies to address their 
areas of weakness. 

Consequences for districts. States have been slower 
to develop district-level systems of accountability; 
only 1 7 states hold districts accountable for student 
or school performance. 

Consequences for students. As states have imple- 
mented school-based accountability systems, educa- 
tors and policymakers have begun to question the lack 
of student incentives in these policies. Teacher suc- 
cess is dependent on student efforts in school, but there 
is nothing in school-based accountability systems that 
motivates students to take the tests seriously, espe- 
cially in secondary schools. Nor are there any conse- 
quences for students who perform poorly on the tests. 

In response to this, several states have enacted pro- 
motion gates: students cannot progress to the next 
grade if they do not meet district or state performance 
standards. By 2008, students in 28 states will have to 
pass a state examination to graduate from high school. 
Political and community opposition to high stakes for 
students has developed in some of these states. 

Aligning Accountability Systems 
with Title I 

The intent of lASA was to create single and ‘‘seam- 
less” accountability systems that would treat all 
schools equally. States were expected to develop 
aligned systems of high standards, challenging assess- 
ments, and accountability, and then align their Title I 
programs with these policies. We found, however, that 
only 22 states will have a single or unitary account- 
ability system in place by 2000-2001. In these sys- 
tems, all schools and/or districts are held to the same 
performance standards regardless of their Title I sta- 
tus. (See Table 1 .) 

Twenty-eight states operate dual systems of account- 
ability in which either Title I and non-Title I schools 
are held accountable using different sets of indicators 



Table 1 . Alignment of Title 1 and General State 
Accountability Systems, 1999-2000 


State 


Unitary Systems 


Dual Systems 


Alabama 


X 




Alaska 




X 


Arizona 




X 


Arkansas 




X 


California 


X 




Colorado 




X 


Connecticut 


X 




Delaware’ 


X 




Florida 


X 




Georgia^ 




X 


Hawaii 




X 


Idaho 




X 


Illinois^ 


X 




Indiana 




X 


Iowa 


X 




Kansas^ 




X 


Kentucky 


X 




Louisiana 


X 




Maine^ 




X 


Maryland 


X 




Massachusetts’ 


X 




Michigan 




X 


Minnesota 




X 


Mississippi 




X 


Missouri 




X 


Montana 




X 


Nebraska 




X 


Nevada 




X 


New Hampshire^ 




X 


New Jersey 




X 


New Mexico^ 


X 




New York^ 


X 




North Carolina 


X 




North Dakota 




X 


Ohio 


X 




Oklahoma 




X 


Oregon^ 


X 




Pennsylvania 




X 


Rhode Island 


X 




South Carolina 




X 


South Dakota 




X 


Tennessee 




X 


Texas 


X 




Utah 




X 


Vermont’ 


X 




Virginia 


X 




Washington 




X 


West Virjginia 


X 




Wisconsin 


X 




Wyoming’ 




X 



1 . Planned to be implemented in 2000-2001 . 

2. Planned to be implemented in 2000-2001 , pending federal 
approval. 

3. Planned to be implemented in 2000-2001 , pending state board 
approval. 



and/or performance standards, or only Title I schools 
are held accountable outside of the performance re- 
porting structure. 

Assisting Low-Performing 
Schools 

In most of the unitary accountability systems, states 
identify schools that do not make adequate yearly 
progress for program improvement. In states without 
a state-defined accountability system, only Title I 
schools are targeted for improvement. 

Under IAS A, districts have the primary responsibility 
for assisting schools that have been identified for pro- 
gram improvement. States provide various forms of 
assistance to low-performing schools. The mix and 
level varies across states and districts, but we have 
identified four primary kinds of assistance. 

Support in school improvement or corrective action 
planning. State departments of education provide 
needs assessments, on-site evaluations, assistance and 
training in data analysis, and other forms of technical 
assistance to help schools and districts create school 
improvement plans that identify weaknesses and strat- 
egies for improvement. 

Financial assistance. Some states offer additional 
funding for the school improvement planning process 
and other school improvement initiatives. 

Expert assistance in planning and instruction. State 
and local education officials and teachers provide tech- 
nical assistance on best practices and staff develop- 
ment at school or district sites. 

State- or regionally-sponsored professional develop- 
ment States create professional development pro- 
grams for administrators and staff from low-perform- 
ing schools. 

Finally, states draw on multiple resources in provid- 
ing assistance to schools including the use of school 
improvement or support teams, distinguished educa- 
tors who serve as school coaches, state department of 
education staff members who make regular monitor- 
ing visits and provide assistance, and regional and 
external service providers. 



Conclusion 

This policy brief shows that state responses to calls 
for performance-based accountability have not been 
uniform. State accountability systems have common 
elements — assessments, standards, performance re- 
porting and, in most cases, consequences of perfor- 
mance — but states have found different ways to de- 
fine what it means for schools to succeed, what indi- 
cators to include in their definition of success, and 
what the consequences will be. These variations re- 
flect differences in state demographics, political cul- 
ture, educational governance structures and policies, 
and educational performance. This raises important 
issues for educational leaders, policymakers, and in- 
terested consumers. 

Accountability. Many states apply dual accountabil- 
ity systems to Title I and non-Title I schools instead 
of the intended single and “seamless” accountability 
system that would treat all schools the same, an lASA 
goal. Also, some states have not set specific perfor- 
mance goals or have not identified low-performing 
schools. 

Assessment State assessments are the cornerstone of 
state accountability systems. Policymakers face three 
challenges in developing assessments that are valid 
and politically acceptable measures of student perfor- 
mance. 

First, what is the appropriate mix of norm-referenced 
and criterion-referenced items in an assessment, and 
how can states determine which items are aligned with 
state standards and should be used to hold schools 
and districts accountable for student performance? 

Second, the federal government expects states to in- 
clude multiple measures of student performance in 
their high-stakes accountability systems, but 
policymakers and the education community do not 
have a clear or common understanding of what this 
means. The case of multiple measures takes on even 
greater importance when making high-stakes decisions 
about individual students. 

Third, policymakers face an increasing public back- 
lash in this new high-stakes environment of student 
testing. 



Equity, Important questions of equity exist as states 
determine which students are tested under what con- 
ditions, and ask if all students have access to teachers 
with a strong content knowledge and to the academic 
program they need in order to meet the new academic 
standards. Closing the achievement gap requires ad- 
dressing inequities that exist in opportunities to leam 
to high standards. 

Capacity. Finally, policymakers need to consider if 
states and districts have the capacity to support the 
school improvement efforts of struggling and failing 
schools. States and districts need knowledge, human 
resources, and financial resources to turn around 
poorly-performing schools. Although we are learning 
more about how to work with low-performing schools, 
we need considerably more research on the roles that 
states and districts play and on the kinds of assistance 
they provide to schools in need. 
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